Energy management of multi-mode plug-in hybrid electric vehicle using multi-agent deep reinforcement learning
نویسندگان
چکیده
The recently emerging multi-mode plug-in hybrid electric vehicle (PHEV) technology is one of the pathways making contributions to decarbonization, and its energy management requires multiple-input multiple-output (MIMO) control. At present, existing methods usually decouple MIMO control into single-output (MISO) can only achieve local optimal performance. To optimize globally, this paper studies a method for PHEV based on multi-agent deep reinforcement learning (MADRL). By introducing relevance ratio, hand-shaking strategy proposed enable two agents work collaboratively under MADRL framework using deterministic policy gradient (DDPG) algorithm. Unified settings DDPG are obtained through sensitivity analysis influencing factors working mode attained parametric study ratio. advantage demonstrated software-in-the-loop testing platform. result indicates that rate greatest factor Using unified ratio 0.2, system save up 4% compared single-agent 23.54% conventional rule-based system.
منابع مشابه
Multi-Agent Deep Reinforcement Learning
This work introduces a novel approach for solving reinforcement learning problems in multi-agent settings. We propose a state reformulation of multi-agent problems in R that allows the system state to be represented in an image-like fashion. We then apply deep reinforcement learning techniques with a convolution neural network as the Q-value function approximator to learn distributed multi-agen...
متن کاملEnergy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning
An energy management strategy (EMS) is important for hybrid electric vehicles (HEVs) since it plays a decisive role on the performance of the vehicle. However, the variation of future driving conditions deeply influences the effectiveness of the EMS. Most existing EMS methods simply follow predefined rules that are not adaptive to different driving conditions online. Therefore, it is useful tha...
متن کاملDetailed Modeling and Novel Scheduling of Plug-in Electric Vehicle Energy Storage Systems for Energy Management of Multi-microgrids Considering the Probability of Fault Occurrence
As an effective means of displacing fossil fuel consumption and reducing greenhouse gas emissions, plug-in electric vehicles (PEVs) and plug-in hybrid electric vehicles (PHEVs) have attracted more and more attentions. From the power grid perspective, PHEVs and PEVs equipped with batteries can also be used as energy storage facilities, due to the fact that, these vehicles are parked most of the ...
متن کاملLenient Multi-Agent Deep Reinforcement Learning
Much of the success of single agent deep reinforcement learning (DRL) in recent years can be attributed to the use of experience replay memories (ERM), which allow Deep Q-Networks (DQNs) to be trained efficiently through sampling stored state transitions. However, care is required when using ERMs for multi-agent deep reinforcement learning (MA-DRL), as stored transitions can become outdated bec...
متن کاملTwo-Surfaces Sliding Mode Controller for Energy Management of Electric Vehicle Based on Multi Input DC-DC Converter
In this paper, a two-surfaces sliding mode controller (TSSMC) is proposed for the voltage tracking control of a two input DC-DC converter in application of electric vehicles (EVs). The imperialist competitive algorithm (ICA) is used for tuning TSSMC parameters. The proposed controller significantly improves the transient response and disturbance rejection of the two input converters while p...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied Energy
سال: 2023
ISSN: ['0306-2619', '1872-9118']
DOI: https://doi.org/10.1016/j.apenergy.2023.121526